(N 



00 

O 



X 



Problems of Information Transmission, 
vol. 48, no. 3, pp. 3-23, 2012. 



M. V. Burnashev, Q H. Yamamoto 



ON RELIABILITY FUNCTION OF GAUSSIAN CHANNEL 
WITH NOISY FEEDBACK: ZERO TRANSMISSION RATE 

fNJ . For information transmission a discrete time channel with independent 

additive Gaussian noise is used. There is also feedback channel with independent 
; additive Gaussian noise, and the transmitter observes without delay all outputs 

(3JQ[ of the forward channel via that feedback channel. Transmission of nonexponential 

number of messages is considered and the achievable decoding error exponent for 
such a combination of channels is investigated. It is shown that for any finite noise 
"^1" i in the feedback channel the achievable error exponent is better than similar error 

exponent of the no- feedback channel. Method of transmission/decoding used in 
the paper strengthens the earlier method used by authors for BSC. In particular, 
for small feedback noise, it allows to get the gain of 23.6% (instead of 14.3% 
c« ■ earlier for BSC). 

lHj' 

§ 1. Introduction and main results 

00' 

We consider the discrete time channel with independent additive Gaussian noise, i.e. if 
x = (xi, . . . , x n ) is the input codeword then the received block y = (yi, . . . , y n ) is 



Vi = Xi + £,i, i = l,...,n, (1) 

where £ = (£i, • • • , £ n ) are independent jV(0, 1)-Gaussian random variables, i.e. E£j = 
0, E£ 4 2 = 1. There is also a noisy feedback channel which allows to the transmitter to 
observe (without delay) all outputs of the forward channel 

z i = y i + ar] i , i = l,...,n, (2) 

where r\ = (rji, . . . ,r] n ) are independent (and independent of £) jV(0, 1)-Gaussian random 
variables, i.e. E?^ = 0, Yirjf = 1. The value o > 0, characterizing the feedback channel 
noise intensity, is given. No coding is used in the feedback channel (i.e. the receiver simply 
re-transmits all received outputs to the transmitter). In other words, the feedback channel 
is "passive" (see Fig. 1). 



lr rhe research described in this publication was made possible in part by the Russian Fund for 
Fundamental Research (project number 12-01-00905a). 
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Fig. 1. Channel model 
We assume that the input block x satisfies the constraint 

n 

5>?<nA, (3) 

where A is a given constant. We denote by AWGN(A) the channel (OQ) with constraint ([3]) 
without feedback, and by AWGN(t4, a) that channel with noisy feedback ([2]). 

Since Shannon's paper |TJ it has been known that even noiseless feedback does not increase 
the capacity of the Gaussian channel (or any other memoryless channel). However, feedback 
allows to improve the decoding error probability (or simplify the effective transmission 
methods) . In the case of noiseless feedback possibility of such improvement of the decoding 
error probability with respect to no-feedback channel was shown for a number of channels 
in [2-9]. 

We consider the case when the overall transmission time n and M = equiprobable 
messages {8\, . . . , 6m} are given. After the moment n, the receiver makes a decision 9 on the 
message transmitted. We are interested in the best possible decoding error exponent (and 
whether it exceeds the similar exponent of the channel without feedback). 

Such problem (for R = 0) was first considered in [T0~|[TT] for a binary symmetrical channel. 
Later in [T2] IT3] , the case of positive rates (i.e. R > 0) was also investigated. The paper aim 
is to get similar (in fact, much stronger) results for a Gaussian channel. 

Some results for channels with noiseless feedback can be found in [2-9], and for the case 
of noisy feedback - in [TT] [T5] (see also discussion in |11|). 

In order to compare with this paper results, we remind briefly earlier results from [10j-[13j. 
There the binary symmetrical channel BSC(p) with similar feedback channel BSC(pi) was 
considered. It was shown in |10]-|13| that there exists a certain critical value p cr it{p-, R) > 0, 
such that if p\ < p cr it{p,R), then it is possible to improve the decoding error exponent of 
the no-feedback channel. If, in particular, both R and p\ are small then the gain is 14.3%. 
In order to get such improvement the transmission/decoding method with one "switching" 
moment was developed and investigated. 

The method of papers [TO] ITT] was applied to Gaussian channel AWGN(A, a) in [16J with 
similar to papers [TOT ITT] results (in particular, with the same asymptotic gain 14.3%). 

Remark 1. The transmission method used in |10]-|13], reduces the problem to testing of 
two most probable (at some fixed moment) messages. It was mentioned in [TT| Remark 1] 
and [T3J Remark 3] that such method is not optimal even for one switching moment. 
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In the paper, still using one switching moment, we essentially improve the 
transmission/decoding method of |10|-|13|. We show that for any noise intensity a 2 < oo 
it is possible to improve the best decoding error exponent E(M, A) of AWGN(A) channel 
without feedback. 

The transmission/decoding method with one switching moment, giving such improvement 
is described in §§2-3. It strengthens the method introduced by authors earlier in |10]-[13j. 
Of course, if a is not small then the gain is small, but it is strongly positive. In other words, 
in the problem considered there is no any critical level cr crit , beyond which it is not possible 
to improve the exponent E(M, A). 

Remark 2. The paper methods can be applied for BSC as well, strengthening the results 
of [10] [13]. In particular, for BSC there is no critical level p C rit{p) < 1/2, beyond which it is 
not possible to improve the exponent E(M,p). 

Remark 3. We consider the case when feedback noise intensity a 2 > is fixed and does not 
depend on the number of messages M. The case when the value a 2 M is small, corresponds, 
in a sense, to the noiseless feedback case (cf. |16]). 

For x,y EMJ 1 denote 

n 

(x,y) = ^2xiVi, \\x\\ 2 = (x,x), d(x,y) = \\x-y\\ 2 . 

i=l 

A subset C = {xi, . . . ,Xm} with \\xi\\ 2 = An, i = 1,...,M is called a (M, A, n)-code of 
length n. 

For a code C = {x{\ denote by P C (C) the minimal possible decoding error probability 

P C {C) = minmaxP(e|;Ej), 

i 

where P(e\xi) - conditional decoding error probability provided x,i was transmitted, and 
minimum is taken over all decoding methods (it will be convenient for us to denote the 
transmitted message both 9i and Xi). 

For M messages and AWGN(A) channel denote by P e (M, A,n) the minimal possible 
decoding error probability for the best (M, A, n)-code. We are interested in the best exponent 
(in n) of that function 

E(M, A) = limsup - In 1 

n _>oo n P e (M,A,n) 

Similarly, for AWGN(t4, a) channel denote by P e {M, A, a, n) the minimal possible 
decoding error probability and introduce the function 

1 1 
F(M, A, a) = limsup - In 



n P e (M,A,a } n)' 

In the paper we consider the case when M is a fixed number of messages, or M = M n — > oo 
as n — > oo, but M n = (it corresponds to zero-rate of transmission). 
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It is known that E(M, A) is attained for a simplex code |17[ |6] 

AM 



E(M, A) 



(4) 



[6J 



4(M- 1)' 

It is also known that if a = (i.e. in the case of noiseless feedback) then for a fixed M 

F(M,A,0) = ^. 

For AWGN(A, a) channel denote by F\(M, A, a) the best error exponent for the 
transmission method with one switching moment, described in §§2-3. Then Fi(M, A, a) < 
F(M, A, a) for all M, A, a. 

One of two the paper main results is as follows. 

Theorem 1. Let InM = o(n), n — > oo. Then: 

a) If cr — y then the formula holds 



F 1 (M,A,a) > 



AM 



4(M- 1) 



1 + 



1 



1 



2 + v/5 2M 



+ o(l) 



(5) 



Since 1/(2 + V5) ~ 0.236, then for large M the formula ([5]) gives 23.6% of improvement with 
respect to no-feedback channel. 

b) // a — > oo then the formula holds 



Fi(M,A, cr) > 



AM 



4(M-1) 



l + ^7 + 0((T- 4 ) 

56a 2 V ; 



> £(M, A) 



AM 



4(M- 1)' 



(6) 



In §3 the second paper main results - a more general theorem 2, valid for any o~ 2 < oo, 
is proved. Theorem 1 follows from it. 

In a standard way reliability functions E(R, A) and F(R, A, a) of no-feedback channel 
and AWGN(t4, cr) channel with noisy feedback can be defined. Then from theorem 1 we get 

C o r o 1 1 a r y. a) For a — > and R = the formula holds 



F(0,A,a)>F 1 (0,A,a)>j 
b) For a — > oo and i? = the inequality holds 



1 + 



2 + V5 



1 + 



1 



56cr 



+ 0(a- 



+ o(l) 



>E(0,A) = ^. 



(7) 



(8) 



In order to simplify formulas we will pay attention only to exponential (in n) terms, 
omitting power factors. Moreover, / ~ g means that n _1 ln/ = n _1 lng + o(l), n — > oo. 
Similarly / < g, etc. is meant. Greek letters £, w, (, £i, . . . designate A^(0, 1)-Gaussian random 
variables. 
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In § 2 the transmission method with one switching moment and in § 3 its decoding are 
described. In § 4 that method is investigated and general theorem 2 is proved. Using theorem 
2 in § 5 theorem 1 is proved. 

Some preliminary (and simplified) version of the paper results (without detailed proofs) 
were published in [18J. 



§2. Improved transmission/decoding method 

We use the transmission strategy with one fixed switching moment at which the coding 
function will be changed. The transmission method used earlier in [T0]-[13] (and in |16| ) 
reduced the problem to testing of two most probable (at some fixed moment) messages. We 
improve that strategy in both transmission and decoding stages. 

In order to simplify formulas we start with case M < (n + 2)/2. We partition the total 
transmission time [1, n] on two phases: [1, M — 1] (phase I) and [M, 2M — 2] (phase II). Thus 
the total length of the code used is 2M — 2. The remaining time [2M — l,n] is not used. 
After moment 2M — 2 the receiver makes a decision in favor of the most probable message 
9i (based on all received on [1, 2M — 2] signals). 

Each of M codewords {Xi} of length 2M — 2 have the form cCj = (x' i} x"), where x\ has 
length M — 1 (to be used on phase I) and x" has length M — 1 (to be used on phase II). 
Similarly, the received block y has the form y = (y',y"), where y' is the block received 
on phase I and y" is the block received on phase II. Denote by z' the received (by the 
transmitter) block on phase I. The codewords first parts {a?-} are fixed, while the second 
parts {x"} will depend on the block z' received by the transmitter on phase I. 

We set two positive constants A%, A 2 such that 



A 1 + A 2 = nA, (9) 



and denote 



A 2 MA\ MA 2 A 2 _ (M-l)fl 

^"V A3 "M^1' M -yTTY ^~T 3 - M ■ (10) 



Then A = (1 + 0)A 1 /n. 
Denoting 



di = d{x\,y') = \\y' - x 



'II 2 

ill ) 



arrange the distances {di, i — 1, . . . , M} for the receiver after phase I in the increasing order, 
and denote 

d {1) = mmd(xly') < d {2) <...< d (M) = maxd(x' i: y') 

i i 

(case of tie has zero probability). Let also x l<yl \ . . . ,x'^ M ^ be the corresponding ranking of 
codewords {x'} after phase I for the receiver, i.e x'^ is the closest to y' codeword, etc. 
Similarly, denoting 

dt ) = d{x' l ,z') = \\y>-z' l \\\ 
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arrange the distances {d\ , i = 1, . . . , M} for the transmitter after phase I in the increasing 
order, and denote 

= mind? < dP* <...< = maxdf. 

i i 

Let also x'^, . . . , x'^ 1 be the corresponding ranking of codewords {x 1 } after phase I for 
the transmitter, i.e x'^ is the closest to z' codeword, etc. 

Transmission. On phase I the transmitter uses a simplex code of M codewords {x'A- of 
length M — 1 such that ||a?-|| 2 = A x . 

For phase II we set a number r > 0. Based on the received block z' the transmitter 
selects three most probable codewords ( ' and calculates for them the value 

4f = rfC3>* - d<2)* = TA 3 > 0. 

The code {x'l} with Ha^'H 2 = A2, k = 1, . . . , M used by the transmitter on phase II depends 
on codewords ' { ' and the value r as follows. 

Case 1. If after phase I 

45 = T A 3 < r A 3 , (11) 

then on phase II the transmitter uses the same simplex code of M codewords {x[} of length 
M - 1, such that ||<|| 2 = A 2 . 
Case 2. If after phase I 

45 = rA 3 > r A 3 , (12) 

then on phase II the transmitter uses another code {x'[\ with ||a4'|| 2 = A 2 , k = 1, . . . , M: 

a) two most probable messages 6*j, 9j have opposite codewords x'[ = —x" which have 
nonzero coordinates only at moment M — 2; 

b) remaining M — 2 messages {8k} use a simplex code of M — 2 codewords {x'l} of length 
M — 3 trailed by at moment M — 2. All those codewords {x'l} are orthogonal to the first 
two codewords (x'-,x'j). 

This transmission method strengthens the method used in |10j-[13j. The code used in 
case I helps in the case when after phase I three most probable codewords 
are approximately equiprobable. 

Decoding. Due to noise in the feedback channel the receiver does not know exactly 
codewords and the value r for them, and therefore it does not know the code 

used on phase II. But it may evaluate probabilities of all possible codewords 
and the value r for them, and so find the probabilities with which any code was used. 

It allows to the receiver, based on the received block y, to find posterior probabilities 
{p(y\xi)} and make decision in favor of most probable message 9i. Such full decoding is 
described in details below. 

§ 3. Full decoding and error probability P e 

Note that 

1 p(y\ x z) , \ 1 /11 112 11 ii2\ 
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If x tvue is the true codeword then y = x tvue + £ and £ = (£', £") = (£1, . . . , £ n ), where all {&} 
are independent jV(0, 1)-Gaussian random variables. If x tTue — x i, then 

— \ = (^2 - xi, £) - - \\x 2 - xi\\ , 
p{y\xi) 2 

where (x,£) is jV(0, ||cc|| 2 )-Gaussian random variable. 

The receiver makes decision after moment n using all received block y. If after phase I 
the difference — is rather close to r A 3 (see f TTTj) and (I12p ) then due to noise in the 
feedback link the receiver can not be sure which code was used by the transmitter on phase 
II (since lists {cc , x'^ 1 } and {x l<yV>t } x ,( - 2 ^} may turn out to be different). But based on y' 
the receiver knows the probability distribution of the code used by the transmitter on phase 
II. Then in the decoding it should take into account that distribution. 

Note that if 9 tTue = 6± then 

d l -d 1 = 2A 3 + 2(x[ - x' { , £'), i = 2, . . . , M. 
If $truc = $i) then for decoding error probability P e we have 

P„ P { max In ' > OlA, V < .VP <( In > qI^ 



i>2 



p 


{y\9i) 


p 


WO 



p(y\Qi) 



MP{X + Y > 0|6>! } 



where 



X = In P [ y |^ 2 | = (y', x' 2 - x[) = -A 3 + (x' 2 - x[, O, 



(13) 



p(2/"|?/A)' 

In order to investigate random variable Y introduce the following sets of random events 
(conditions): 

Zi = : 4! < r A 3 } , 
Z 2 = [z' : 45 > r A 3 , {x[,x£ = {x' {1) \ x' {2)t }) , 
Z 3 = [z' : 43 > r A 3 , |K, ^} Q^ 1 V (2)4 }| = l} , 

Z 4 = [z' : 4? > r A 3 , x' 2 } f|{* ,(1) \ ^' (2) '} = 0} • 

We assume that the true message is 9\. Then using sets Z 2 ,Z 3 ,Z 4 it will be possible to 
describe all possible relations between pairs {x f{1 \x' {2) } and {x 1 ^ 1 , x'^ 1 } of most probable 
messages for the receiver and the transmitter, respectively. 
Denote 

p k = P(Z k \y',x' 1 ), £; = !,..., 4. 
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We have 



= E 



p{y"\y',0i) z ' ly ' P (y"\z',x'() 

where blocks x'[, x 2 depend on k (via Z k ). If true = 9i, then y" = x'[ + and 



{y",x'i-x'D 



p{y"\y',e 2 ) 
p(y"\y',0i) 



-A 2 



^PkZ 



(X>l,X>i)+{£' ,x>i-x'i) 



k=l 



Y < ln4 - A 2 + max{(x'(, x' 2 r ) + (£", x" 2 - x'[) + lnp fc }. 
Therefore 

P c < MP{X + Y > O|0i} = ME y ,P{X + Y > O|2/',0i} < 
< ME^P |X + In 4 - A 2 + ma X {(s' 1 ' ) x£) + (£", x£ - + lnp fc } > 0|3/ , ,6» 1 } 



< 



< M ]T E y ,P {X + In 4 - A 2 + « 40 + (£", < ~ O + ^Pk> 0\y', Z k , 9 1 } < 



k=i 

< -M^E 



k=i 



[A 2 -X-(x'{,x'i)-\n Pk ] 2 + \ 1 
2 1| x' 2 ' -x'{ || 2 



fc=i 



where 



5 fc = -lnE^eA fc = l,...,4, 



L4g + A 3 - - gUQ - 4) - lnp fc ]; 
2||^2 2 

Here (a^ — cc^O = \^2A^£i, where £ ~ A/"(0, 1), for all k, and x'[,x 2 depend on k. In 
particular, 

61 = AM ^ 3 + Aa ~ ^ ~ X>1 ' ^ ~ lnpi]2+ ' 

[A 3 + 2A 2 -(x' 2 -x[^')-\np 2 } 2 + , 



6,= 



8A 2 
1 



64 = 



4A 2 
(M-3) 
AA 2 (M-2) 



[A 3 + A 2 - (x' 2 - x[, £') - lnp 3 ]+ , 



^3 + 



(M - 2)A 2 
M-3 



[x' 2 - - lnp 4 



Then 



Fi(M, A, a) > min B k . 

fc=l,...,4 



(14) 
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We should find values Bk,Pk, k = 1,...,4 and choose optimal parameters /3,tq. We 
show below that in interesting for us cases probabilities pi,Ps,P4 are small, and therefore 
the probability P2 is close to 1. Moreover, we omit estimates for values P4, B4, since clearly 
P\ < P3 and B.± > £> 3 . 

We start with the simplest term i? 2 . Note that if £ ~ A/"(0, 1), then 

-afe 2 /(2+2a) 

Ee -«(6-OV2 = e a > _i. 

Neglecting hxpk, we get (as n — > 00) 

E^e" 6 * < P{6 2 = 0} + Eexp {--L [A3 + 2A 2 - (x' 2 - a?!, £')] 

= P I > A 3 + 2A 2 } + E exp 



A. 



4A, 



A 3 + 2A 2 ' 



< 



^<r,f A 3 + 2A 2 ^ f A 3 + 2A 2 \ 



4 J "1 4(M-l)(l + /3) 

where we used simple inequality 

OO 

§(-z) = -L J e- u2/2 du < \e~ zV \ z > 0. (15) 

Inequality (fT5l) will be regularly used in the paper. Therefore 

MA(1 + 2aQ 1 
S2 " 4(M-l)(l + /3) - n" (16) 

Calculation of values .83 will demand more efforts. It is done in the next section. 

§4. Probabilities p\,ps and values Bi,B^. Theorem 2 

It will be convenient to use the following technical result, which allows instead of a 
simplex code to consider an orthogonal code. Let {zj G IR n , i — 1, . . . , M} - a simplex code 

M 

with ||zi|| 2 = A and M < n. Since = 0, then denoting r = Af(M — 1), we have 

k=l 

\\Zi - Zj\\ 2 = 2rM; (z i ,z j ) = -r, i ^ j; (z 3 - z x , z 3 - z 2 ) = rM. 

Set an arbitrary vector u G M n , such that u J_ . . . , Zjf} and ||w || 2 = r, and consider 
vectors itj = Zi + ito, z = 1, . . . , M. Then (uj, Uj) = 0, % 7^ j and \z\ — Zj\\ = \\v,i — Uj\\ for 

M 

any i, j. In particular, we have u = M _1 Uj. This result can be formulated as follows. 

j'=i 
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Proposition 1. Let \z{ G R n ,i = 1, . . . , M} be a simplex (i.e. equidistant) code 
with \\zi\\ 2 = A. Then it can be represented as 

1 M 

Zi = Ui-u , i = l,...,M, u o = Jf^2 u v ( 17 ) 

3=1 

where {Ui,i = 1, . . . , M} are mutually orthogonal (i.e. (ui,Uj) = for i ^ j) vectors with 
\\ui\\ 2 = AM/(M — 1). 

Using Proposition 1 we replace vectors {x[} by orthogonal vectors {ui = x\ + u } such 
that ||Hi|| 2 = A 3 and (u i: Uj) = 0, % ^ j. Then x[ — x • = u\ — u^. Denote 

= V^3& = u i A 3, {Ui,r]') = ^/A^r]i = ViA 3 , i = l,...,M. 
Note that if we would omit {lnpj} from {6j}, then, for example, we have 

fir I 2 M 2 + u 2 

Bi = -lnE^e- 61 ~ min <^ — - A 3 + A 4 + ^y/ A 3 — u 2 y/ A 3 + 1 - 2 \ = 
s> ui,u 2 [4A4 L ' J 2 J 

A 3 (l + f3) 
4 

which corresponds to no-feedback case. Similar estimates would hold for B 3 as well. Therefore 
for given y' = {u^} we should evaluate and take into account conditional probabilities pk = 
P(Z fc |y',a!' 1 ). 

Note also that for large M values 61,63,64 are approximately equal. Then it would be 
sufficient to evaluate how close is p 2 to 1. 
In order to evaluate p±, introduce events 

An = |max{4* ) ,4* ) } < minrf^ < maxjdf^?} + r Q A 3 

1 

(df - df) + < mindf - df < (df - df) + + r A 3 

i>3 

A 13 = jmaxrf, df} < df < maxrf, df} + r A 3 | , 
A 23 = {max{4 t) , df} < df < max{df, df} + t A 3 } . 



Then 

Pi < (M-l) 2 [P{A l 2\y',x' 1 } + P{A 23 \y',x' 1 } + P{A 13 \y , ,x , 1 }\ < 
<3(M-l) 2 P{A 12 \y',x' 1 }, 

since P {.A23I2/, x[} < min [P {.A12I2/, x'i} , P {^4.13 1 2/' 5 ^'1}]) an d due to symmetry 
P {A\ 2 \y' , x[} ~ P {*4i3|j/, a^}. Therefore it is sufficient to evaluate the probability 
PiAnly',^}. 

If cc^rue = x[, then for i > 2 

df) - df) = 2(«i - Wi , £' + (777') + 2A 3 = 2A 3 (1 + mi - + 2cr v /A^(7 7l - m). 
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(18) 



Denote 

Wia = (1 + Ul - Ui )^/A~ 3j i = 2,...,M, sa = r 0V / ^/2. (19) 
Then ({77,} are independent A/"(0, 1)-Gaussian random variables) 

P {A2I2/, = P { < Vi ~ {w 2 + Vi- V2)+ + min{w; - ^} < s\y' 

I i>3 

= P |o < 771 + rmn{wi - rji} < s, w 2 + r/i - T) 2 < 0|y' j + 
+P |o < T] 2 - w 2 + min{wj - r]i} < s, w 2 + % - r] 2 > 0|y' j < 
< P < r]i + min{wi - < s\y' > + P < r] 2 - w 2 + min{wj - r)i} < s\y' > < 

I *>3 J I i>3 J 

< (M — 2) [P {w 3 + I?! - % < S} + P {w 3 - W 2 + 772 - % < S>] < 

< 2(M - 2)e~ [wz ~ {w2)+ ~ s] + /i 1 

where on the last step the inequality (Il5l) was used. 
Using ( JT8|) . for £>! we get 

\n Pl < -[w 3 - {w 2 ) + - s\l/A + ln(6M 3 ). (20) 



Consider values bi and B x - Below in brackets, for short, we omit relatively small term 
ln(6M 3 ), but it will be taken into account in the final result. Using (120]) we have 



61 > 



4A 4 

A3 
"4/3 



A 3 + A A - {u 2 - ui, O + -{w 3 - (w 2 ) + - s)l 



1 2 



1 + ft + U\ - u 2 



A 

4/3 



4A 3 

3 [P + y 2 + i(y 3 -(y 2 ) + -r /2) 2 + ] 



(w 3 - (w 2 )+ - s) 

21 2 



where we denoted 



7 = 1/ (4cr 2 ), yi = awi/ \/A 3 = 1 + «i - 



(21) 



(22) 



Therefore (if integration limits are not pointed out then it is done over all possible area) 



2vr 



3/2 




exp <^ -h(y 2 ,y 3 ) 




I,/ \ ^3(^1 + ^2 + m|) , , . , 
exp <^ —61(2/2, 2/3) o r duidu 2 du 3 



^ [«? + (1 +«i - 2/ 2 ) 2 + (1 +iti - t/ 3 ) 2 ] I du 1 dy 2 dy 3 = (23) 



2tt 
3^ 



-6l(2/2,2/3)-4 3 ff(j/2,2/3)/3 



2tt 



-A3/i(y 2 ,y 3 )/(i2/3) 
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2 , 2 i+«v , 3(1 



where 

g(u, v) = 1 + u 2 + v 2 — uv — u — v = I v ^ — J + 

fi{V2, y 3 ) = 3 [0 + y 2 + j{ys - {y 2 )+ - r /2f + ] \ + i(lg{y 2 , y 3 ) 
Represent the last integral in the right-hand side of ( 1231) as follows 



e -A 3h (y 2 ,y 3 )/(m dy2dy3 = h+h + / 3; 

where 

h = J J e- A ^y^y^dy 2 dy 3 , i = 1,2,3, 

Vi 

and 

Vt = {/3 + y 2 < 0}, V 2 = {-/3 <y 2 < 0}, V 3 = {y 2 > 0}. 
We evaluate consecutively integrals Ii,I 2 ,I 3 . For 1% we have 

h< ff e' A39{ y^ 3 dy 2 dy 3 = 



oo 



j/2<-/3 -oo 

Consider the integral I 2 . Denoting z = 7(2/3 — r /2)^_, we have 

fi(y 2 , y 3 ) = 3(2/2 + f3 + z) 2 + 4f3g(y 2 , y 3 ) = 



(3 + 4/3) 



3z + 0{l-2y 3 ) 

m + — 3T^ — 



1 2 



+ 3/3(1 + P)+f 3 (y 3 ), 



/a(ys) = {(! + /?)(!- 22/ 3 ) 2 + 4^(z + 1 + 2/3 + 2/3) } - 



Therefore 



/ 2 < J J e- A ^^/^dy 2 dy 3 < e ~^ 1+ ^ 4 J e~ Ash ^ 12 ^dy 3 . 

j/ 2 >-/3 -00 

If 2/3 < r o/2, then z = 0. Set some level r /2 < u < 1/2. Then denoting z Q = j(u 
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we have 



-oo 
oo 



+ / exp 



e -Asf 3 (y 3 )/(m dy3 < 



cxp 



Mi±0) 

4(3 + 4/3) 



(1 - 2y 3 ) 2 dy 3 + 



< 



exp 



4(3 + 4/3) 
A 3 (l + /3) 



(1 - 2y 3 Y - 



2 A 3 z (z + 1 + 2/3 + m) 



(1 - 2u) 2 ^ +exp 



(3 + 4/3) 
A 3 z (>o + 1 + 2/3 + u 



4(3 + 4/3) 

Set it, such that (1 + /3)(1 - 2m) 2 = 4z (l + 2/3), i.e. set 

v ^T? + r 0V / 7 (l + 2/3) 



(3 + 4/3) 



2u 



Then we get 



and therefore 



e -AsMvs)nm dy3 < exp 



h < exp 



v ^+?+ v / 7 (l + 2/3) ' 

A 3 (l + /3)(l-r ) 2 
'4(3 + 4/3)(l + 2cx) 2 

(1-ro) 2 



1 + 



(3 + 4/3)(l + 2^ 



Consider the integral / 3 from (126|) . Represent it as follows 

-^3 = -^31 + -^32, 



'31 



'32 



-^3/1(2/2,2/3 



mm dy 2 dy, 



3, 



J/2>0,j/3<«/2+r /2 



-A3/1 



(V2m)/(m d y 2d y 3 



?/2>0,J/3>J/2+ro/2 



If 2/3 < 2/2 + V 2 > tnen 

/ifea, 2/3) = /3 (22/3 - 1 - 2/ 2 ) 2 + 3(1 + /3)(/3 + y\). 
Integrating first over y 3 , and then over y 2 , we get 

OO 

J31 < e"*^ / exp {-^(1 - y 2 - ro) 2 , - ^(1 + /3)y 2 2 } dj, 2 < 



< e 



-A 3 (l+/3)/4 



exp 



^3(3 + 4/3) 
12/3 



2/2 - 



/3(l-r ) 
3 + 4/3 



n 2 



A 3 (l + /3)(l-r ) 2 



4(3 + 4/3) 



cxp 



1-To 



1 + 



(i - to); 

3 + 4/3 
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Consider the integral Is 2 . Denoting u = y% — y 2 — Tq/2, we have 



fi(V2, y 3 ) > Ufa, u) = 3(/3 + y 2 f + 6 7 (/3 + y2)u 2 + 
+4/3 [1 + y 2 2 + {u + r /2) 2 + y 2 {u + r /2) -2y 2 -u- r /2] 
= « 2 [6 7 (/3 + y 2 ) + 4/3] - 4/3w(l - r - y 2 )+ 
+3(/3 + y 2 ) 2 + /?(4 + iyl + r 2 + 2y 2 r - 8y 2 - 2r ). 



First we integrate over u and then over y 2 . Since 



/ 4 (2/2,0) 



2/2 



^3 + 4/3 



/3(1 - r ) 



/? 2 (l-r )' 



we have 



/ 32 < 



3 + 4/3 
e -AsMv*,u)/( mdudy2 < 



+ 3/3 2 + /3(4-2t + t 2 ), 



«>0,|/2>0 



< A 3 (l-r ) 2 /[6(37+2)] 



-A 3 / 4 fe2,0)/(12/3)^ 2 < 



J/2>0 



then 



< exp 



^3 < exp 



A 3 (l + /3) 



4,(1 + 0) 



1 + 



2(1 -r ) 5 



3 + 4/3 3(l + /3)(3 7 + 2)_ 
(l-r ) 2 2(1 -r ) 2 



3 + 4/3 3(l + /3)(3 7 + 2)Jj • 1 ' 

That estimate is applicable for all 7 > 0. If 7 is small, then /3 should be chosen such that 
< 97/(2-97). 

As a result, from ([23]), (J2SJ), ([28]), ([29]) and ([32]) we get 



exp 



+ exp 



A 3 (l + (3) 



A 3 (l + /3) 



(l-r ) s 



1 + 



(3 + 4/3)(l + 2<x) 2 
2(1 -r ) 2 



+ 



3 + 4/3 3(l + /3)(3 7 + 2)_ 



(33) 



and then 



1 + min < /3 



A 3 (l + /3) 
Bi > v 

4n 
(1-ro) 2 



2(1 -ro) 1 



(3 + 4/3)(l + 2a) 2 ' 3 + 4/3 3(1 + /3)(3 7 + 2) 



31nM 



(34) 



n 



where the last term in the right-hand side of (1341) takes into account the term omitted in 
(ED. 
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Values p 3 and B 3 are evaluated similarly to values pi,B\. Introduce sets 

Z 31 = {z> : 42 > r A 3 ,{x^\x'^} = {x[,x' 3 }l 
Z 32 = {z' : 4? > r A 3 , {x' {l) \ x' {2)t } = {4, x' 3 }} 

and consider conditional probabilities P31 = P {Z 3 i\y', x[} and P 32 = P {Z 32 \y', x [}- Then 

p 3 <{M- 2) (P 3 i + P 32 ) < 2(M - 2)P 31 , 

since P 31 > P 32 . Then it is sufficient to evaluate P 31 . Using notations ( !T9|) . we have 

P 3 i = P I . = min 4 4) > max{4* ) , <$} + T A 3 \y', x[ 



= P< min [w i + r] l -r] i }> {w 3 + r]i~T] 3 ) + + s\y'\ < 

I «=2,4,5,... J 

< P {w 2 + r/i - 772 > (u>3 + ?7i — + s|j/'} = qi + q 2 , 



where 



qi = P {rji - r] 2 > s - w 2 , r] 3 - 771 > w 3 } , 

?2 = P - ?72 > S ~ W 2 + W 3 , 77i - 773 > -W 3 } . 

Here, for example, 771 — 772 ~ jV(0, 1). For probabilities q\,q 2 we use simple estimates (see 



1 2 1 2 

In <7i < -- [max {s - w 2 , w 3 }} + , In q 2 < -- [max {s - w 2 + tu 3 , -w 3 }]+ • 

Those estimates turn out to be sufficiently accurate, although it is possible to strengthen 
them using dependence among random variables. Then 



ln(P 3 i/2) < — - { min [max {s - w 2 , w 3 },max{s - w 2 + w 3 , -w 3 }}} 2 + 



1 
4 

Using notations (l22l) . after standard analysis we get 

In p 3 - ln(4M) < —fA 3 r 2 {y 2 , y 3 , r ), (35) 



where 



r(y2,y3,r ) = < 



'min{r /2 - y 2 , -y 3 }, y 2 < r /2, y 3 < 0, 

2/3, 2/2 < ro/2,2/3 > 0, 

0, 2/2 > V 2 ,2/3 < 2/2 - V 2 > 

< T /2 - 7/2 + 2/3, 2/2 > ro/2,7/ 3 > 7/2 - r Q /2. 



(36) 



We have 
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where (7/2, 2/3) G R 2 - In order to simplify the right-hand side of (l37j) . first we evaluate 
contribution to S3 of points (2/2,2/3) G -Do 5 where 

A) = {2/2,2/3 : 2/2 < -fi}. 

Using simple inequality f 3 {y 2 ,y 3 ) > 4/ig(j/ 2 , 2/3), and integrating first over y 2 , and then over 
?/3, we get 

00 

Jo = // e- A ^^dy 2 dy z < [ e -M{2y 3 -i + ^/i2-A 3 (i+^/^ dy3 „ e -A 3 [i+tf/^ (3g) 



D 



For remaining points (y 2 , 2/3) G R 2 \ D" = {2/2, 2/3 : 2/2 > — A 4 } = T> we have 

63 > ^ [/i + 2/2 + 7^ 2 (2/2,2/3,i-o)] 2 - (39) 

In order to use the formula fl36|) it is convenient to partition the remaining integration area 
T> on four parts 

4 

Z> = X>, (40) 

where 



(41) 



= {-fJi < 2/2 < r„/2, J/3 < 0}, D 2 = {-fi <y 2 < r /2, y 3 > 0}, 
D 3 = {2/2 > W 2 ) 2/3 < 2/2 - V 2 }, D>4 = {j/2 > r /2, 2/3 > 2/2 - r /2}. 

Then similarly to (1231) we have 

^E r - 6 3<j + ^j. (42) 

3 i=Q 

where 

J i= ff e- A3 ^^^dy 2 dy 3 , % = 1, . . . , 4, 

ir (43) 

73(2/2,2/3) = 3 [// + 2/2 + 7^ 2 (2/2, 2/3, t )] 2 +4^(2/2,2/3), 

and g(u,v) is defined in ( 1241) . 

We evaluate consecutively integrals J 1( . . . . J 4 , starting with J x . For (y 2 , y 3 ) G D 1 ! we have 

/ 3 (2/2, 2/3) > 3(// + y 2 f + Li {2y 3 - 1 - y 2 f + 3/i(l - ?/ 2 ) 2 . 
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Integrating first over 7/3 < 0, and then over all 7/3, we get 



Ji 



-Asfi 



■*to,vsmun) dy3 dy 2 < 



< 



00 

/ exp {~^k ^ + 2/2)2 + + 2/2)2 + 3/i(1 " ^ } ^ 2 ~ 



< 



exp 



A 3 (l + /i) 



1 + 



3 + 4/i 



Consider the integral J2. Then 

/3G/2, 2/3) = 3(/i + y 2 + 72/ 3 2 ) 2 + ^(22/2 - 1 - J/3) 2 + 3/i(l - t/ 3 ) 2 



a/3 + A^y 2 



\i - 2fiy 3 + 372/§ 
v / 3 + 4t7 



+ /3i(ys), 



where 



/3i(jto) 



12/i 



> 



(3 + 4/i) 

12/x(l + //) 
(3 + 4/i) 



{(1 + /i) 2 + 7 2 z/ 3 4 + 72/ 3 2 (l + 2/x + y 3 ) + (1 + -Vs)}> 



1 + /x + ( 7 + l) 



2(7 + 1) 



4(7 + 1) 



Therefore integrating first over all 7/2 > and then over all 7/3, we get 



Ji % exp 



^3(1 + /i) 
4 



1 



3 + 4/x (3 + 4^/)(7 + l) 



For the integral J3 similarly to (144)) we get 

r < f ^3(1 +/i) 

^3 < exp 



1 



3 + 4/i 



Consider the integral J4. Denoting z = t /2 — y 2 + y 3 , we have 



/ 3 (y 2 ,z) = (3 + 4 M ) 
3/i 



1/2 + 



3 7 z 2 + fj,(2z - r - 1) 
3 + 4/i 



+ 3/i(l + /i)+/ 3 (z) 



/: ' ; : ' = (3 +"4^) i 472/ + 27 ^ (4 + 4/1 + To ~ 2z) + (1 + M 2z ~ To " 1)2 } 



Note that 



37^ 2 + li(2z — r — 1) > 0, z > zq 



1 + To 



1 + 71 + 3 7 (1 + T ) ffX 



17 



Therefore for z < zq we integrate over all 1/2 > 



cxp 



A, 



0<z<z ,y 2 >0 



< exp 



12/i 0<-Z<Z 



mm / 3 (z) f < 



1 + 



(1 + ro) 2 
(3 + 4/x) 



-1 2 



1 + V/1 + 3 7 (1 + T )//X 



since 



min f 3 (z) > 

0<Z<Z 



3/x(l + //)(! + r ) 
(3 + 4//) 



1 + Vl + 3 7 (1 + r )/// 



If 2; > 2q then minimum of the function f 3 (jj2, z) is attained for y-i = 0. Also 



f 3 (0,z) >3//(l + //) + 2// 



v/3 7 + 2^ - 



1 + Tq 

V/37T2J 



+ 



3//7(l + T )- 
3 7 + 2 



Therefore 



2>2o,y2>o 



< exp 



A 3 {1 + ii) 



AsMy2,z)/(12,) dy2dz < / e -A3/3(0,*)/(12 M )^ < 



Z>ZQ 



1 + 



7(l + T"o) 5 



(3 T + 2)(1 + //)J 



which gives 



In J 4 < 



A 3 (l + fi) 



, , (1 + ro) 2 . I 7 

1 + mm < . 

(3 + 4//) 1 1 + 7 



-1 2 



1 - 



l + Vl + 37(l + 7o)/// 



(47) 



Then from (SI, (SHI) and fl41D-fH?D we get 



4?(1 + //) 
An 



1 + min < //, 



7 



(3 + 4//)(l + 7 ) 



-1 2 



1 + ^/1 + 3 7 //i 



(48 



As a result, from (|T4|) we get a general result for any a < 00. 

Theorem 2. Let InM = o(n), n — > 00. Then for any a < 00 the inequality holds 
F(M,A,cx) > Fi(M,A,(t) > max min B k + o(l) > £(M,A), n ->- 00, (49) 

f),TQ fc = l,2,3 

where values Bi,B2,B 3 are defined in ( 134"|) . ( TT6l) and ( 1481 . respectively. 

The relation ( 1491) has been proved provided M < (n + 2)/2. In fact, the formula ( 1491 
remains valid for any M such that M = e o( - n \ n — > 00. Indeed, note that instead of simplex 
codes or {x'[} on phases I — II we may use "almost" equidistant codes, for which, for 
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example, ||a^ — ^-|| 2 = 2An(l + o(l)), n — > oo, i 7^ j. All calculations then remain essentially 
the same. Such codes do exist due to the following result. 
Denote by S n the unit sphere in K n centered at 0. 

Proposition 2. For any p £ (0, 1) and n > 3 i/iere exists a code C = {x\, . . . , a; m} C 
with \(xi,Xj)\ < p, % 7^ j, snc/i t/iai 

M > pe np2/2 . (50) 

Proof. Denote by the area of the "cap" cut out from S n by the cone of half- angle 
9. In particular, the area of S n equals Q(tc). Then for any < 9 < ir/2 there exists a code 
C = {xi, . . . , Xm] C S n with I (a?;, a?j)| < cos^, i 7^ j, such that 



M > 



2n(ey 



For the ratio Q(9)/Q(ir) the following estimate is known |17[ formula (27)] 



0(0) 



< 



r Q + l) sin"" 1 



n + 1 



cos 



Using that estimate for p = cos 9 we get 



M > -Vt > 
- 2fi(0) - 



+ 1\ 



nT 



n 



> 



n 



1\ 



\7vrpe 



np 2 /2 



2r(- + i)(i-p 2 )(™- 1 )/ 2 



n 



21 (- + 1)^ 



From the last inequality for n > 3 the estimate (150]) follows. 

8 5. Proof of Theorem 1 



A 



We need to investigate asymptotics of values B\, B2 and -B3 when o — > and a — > 00. 
a) If cr — > then set tq > such that To — > 0. Then for B\ from ( l34j) we have as n -> 00, 
a ->• 



Bx> 



AM 



4(M- 1) 



For i?2 from (jT6]) we have 



5 2 > 



AM 



1 + min < /3, 







3 + 4/3 
2/3 



4(M- 1) L 1 + (1 + /3)M 



For i?q from (14*81) we have 



5, > 



AM(1 + p) 



4(M-l)(l + /3) _ 



> 



AM 



4(M- I) 



1 + min < (3 



1 + min p, 
1 



3 + 4/i 



+ o(l). 



+ o(l). 



> 



3 + 4/3 J M(l + /3) 
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+ o(l). 



Then we get as a — > and n — > oo 

AM r 

min Bu > — 1 + min 

fc=l,2,3 ~ 4(M - 1) [ 







2/3 



1 + /?' 3 + 4/3 J (1 + /3)M 



+ o(l) 



We set /? such that both terms under minimization become equal, i.e. set 

ft = (V5-l)/4 « 0.3090. 

Then we get 



AM 

mm St. > — - 

fe=i,2 >3 - 4(M - 1) 



1 + 



+ o(l) 



2 + V5 2M 

from which the formula (jSJ) follows. 

b) In that case a — > oo, i.e. 7 — » 0. Set To > such that ro — )■ and choose (3 = 7/7, 1. 
Then after simple calculations we get 



AM 

min Bi. > — 

fe=l,2,3 - 4(M - 1) 



l + ^ + o(7 2 



31nM 



7^0, 



from which the formula (J6]) follows. 

Note that in both extreme case as o — > or o — > 00 the value r was chosen such that 
r > 0, but t — >■ 0. For intermediate values of a optimal r 0. 

The authors wish to thank V.V. Prelov for useful discussions and constructive critical 
remarks. They are also grateful to the University of Tokyo for supporting this joint research. 
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